THE LUMPABILITY PROPERTY FOR A FAMILY OF MARKOV 
CHAINS ON POSET BLOCK STRUCTURES 

DANIELE D'ANGELI AND ALFREDO DONNO 

^f-\ ' Abstract. We construct different classes of lumpings for a family of Markov chain 

products which reflect the structure of a given finite poset. We use essentially combi- 
natorial methods. We prove that, for such a product, every lumping can be obtained 
from the action of a suitable subgroup of the generalized wreath product of symmetric 
groups, acting on the underlying poset block structure, if and only if the poset defining 
the Markov process is totally ordered, and one takes the uniform Markov operator in 
each factor state space. Finally we show that, when the state space is a homogeneous 
space associated with a Gelfand pair, the spectral analysis of the corresponding lumped 
Markov chain is completely determined by the decomposition of the group action into 
irreducible submodulcs. 
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1. Introduction 



The study of Markov chains is one of the most useful tools of Probability and has sev- 
eral fundamental applications in many areas of science: Mathematics, Statistics, Physics, 
Chemistry, Mathematical Biology, Information Science, but also in Economics and Social 
Sciences, due to the fact that Markov chains can be used for modelling an infinitely large 
variety of evolution processes. 

One of the most interesting and studied problems in Markov chain Theory is the investi- 
2^ gation of the rate of convergence to the stationary distribution, which is mainly performed 

via the spectral analysis of the associated Markov operator. One is often interested in 
establishing if the convergence to the stationary distribution presents a cutoff. The term 
cutoff is used to describe the situation where the total variation distance between the 
fc-step transition probability and the stationary distribution stays close to its maximum 
value at 1 for a while, then suddenly drops to a quite small value and tends to exponen- 
tially fast [U [16] . The presence of such a phenomenon was proven in a number of models 
[HI EH HSj ; on the other hand, it was shown in [13] that the Markov chain described in 
Section 15.21 of the present paper converges to the limit distribution without a cutoff. 

Lumping a Markov chain appears as a useful tool in this kind of investigation, since by 
lumping a Markov chain the spectral gap cannot decrease. Informally, when a Markov 
chain is lumpable, it is possible to reduce the number of states by a sort of aggregation 
process, obtaining a "smaller" Markov chain. Notice that in J27J Chapter 1] the lumping 
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construction is called factorization, and the lumped Markov chain is called the factor 
chain. In [23] , the weaker notion of quasi-lumpability is introduced: roughly speaking, a 
quasi-lumpable Markov chain is a Markov chain that is not lumpable, but can be altered 
by a small perturbation in such a way that the resulting Markov chain is lumpable in the 
classical sense. In [21], the author provides some new bounds on the rate of convergence 
of aggregated Markov chains; in [22], the lumpability and quasi-lumpability properties 
are used in order to speed up the Markov Chain Monte Carlo, i.e., to reduce its running 
time necessary to get a sufficiently good approximation of the stationary distribution. In 
[28], the lumpability property is used in the study of a family of composition Markov 
chains, having numerous applications as, for instance, to Ehrenfest chains, or to Kimura's 
continuous time chain for the DNA evolution. 

In our paper, we consider a family of finite Markov chains, that we call generalized 
crested products, introduced in [TJ)] and providing a generalization of the crested product 
of Markov chains previously defined in [12], motivated by the construction developed in [7] 
in the context of Gelfand pairs. The theory of crested products was introduced by R. A. 
Bailey and P. J. Cameron [3] in the setting of symmetric association schemes and groups, 
and then extended to the case of arbitrary permutation representations by F. Scarabotti 
and F. Tolli in [26]. Observe that the crested product of Markov chains also generalizes 
some classical diffusion models, e.g. the Ehrenfest model and the Laplace-Bernoulli model 
(see also [23], where the spectral analysis of a combination of these models is performed 
by using Gelfand pair theory). Our Markov chains are naturally defined starting from a 
finite poset (I, ^): given a Markov chain with finite space state Xi, for each i e /, the 
generalized crested product is a Markov chain reflecting the combinatorial structure of 
the poset (I, ^), and whose state space is the cartesian product Xi x ■ • ■ x X n . 

After recalling the definition and some basic facts about lumpable Markov chains, gen- 
eralized crested products and generalized wreath products (Section [2]), we construct in 
Section [3J different classes of lumpings for the generalized crested products of Markov 
chains: the deletion construction (see Theorem [3] and Propositions H] and [SJ , obtained 
by identifying elements which differ only for coordinates indexed by a subset R of /; the 
direct product of lumpings (see Theorem E]), where a lumping partition is obtained as 
a direct product of lumpings of each factor Xf, and the generalized crested product of 
lumpings (see Theorem [7]), which is a partition equivalent of the construction introduced 
in [3] for permutation groups, taking into account the combinatorial structure of the poset 

In Section HJ we recall the so called Insect Markov chain defined in [13] in the more 
general setting of orthogonal block structures, and generalizing a model introduced in 
[25] , whose state space can be identified with the boundary of a combinatorial structure 
called poset block structure, whose automorphism group is the generalized wreath prod- 
uct of permutation groups defined in [3] , and which can be endowed with a metric space 
structure (Lemma [1]). Finally, in Section [5l we focus our attention on lumped Markov 
chains that can be obtained by using the orbit partition associated with the action of 
an automorphism group on the state space. In particular, we prove that if the poset 
(I, :<) is a totally ordered set, so that the corresponding poset block structure is a rooted 
tree, then every lumping of the Insect Markov chain can be obtained from the action of a 
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suitable automorphism group (see Theorem IT21 . We show that, when the state space can 
be expressed as a homogeneous space with respect to the stabilizer of some fixed element, 
then the Gelfand pair theory developed in [TJ] allows to give a complete spectral analysis. 
On the other hand, if the poset (I, :<) is not a chain, we prove that the Insect Markov 
chain admits a lumping that cannot be obtained using the action of an automorphism 
group (see Proposition IT3|) . 

2. Preliminaries 

2.1. Lumpable Markov chains. We recall in this section some basic facts about finite 
Markov chains and lumpability property (see, for instance, [U Chapter 1]). 

Let X be a finite set and let P = (p(x,y)) Xjye x be a stochastic matrix indexed by the 
elements of X. Consider a Markov chain on X with transition probability matrix P. By 
abuse of notation, we will denote by P the Markov chain as well as the associated Markov 
operator on L(X) — {/ : X — > C}, defined as 

(Pf)( x ) = YsP( x >y)f(y)' for a11 / G L{x) yX e x. 

ydX 

Definition 1. The Markov chain P is reversible if there exists a strict probability measure 
tt on X such that 

7i(x)p(x,y) = rr(y)p(y,x), for all x, y G X. 

If this is the case, we say that P and n are in detailed balance [2]. Define a scalar 
product on L(X) as 

(/i, h), = J2 fi^)Mx)<x), for all A, f 2 e L{X). 

x£X 

It is easy to verify that n and P are in detailed balance if and only if P is self-adjoint 
with respect to the scalar product (■, ■) 7T . Under these hypotheses, it is known that the 
matrix P can be diagonalized over R. Let u{P) denote the spectrum of P. Then, one has 
1 G a(P) and |A| < 1 for any A G a{P). 

Starting from a Markov chain P with state space X, the notion of lumpability allows to 
construct a new Markov chain which has a smaller state space. So let C = {L l5 . . . , L^} 
be a partition of X, i.e., X = U^ =1 Lj. Then, for each x £ X and i — 1, . . . , k, put 

p(x,L { ) = ^2p(x,y). 

Definition 2. The Markov chain P is lumpable with respect to the partition L if, for any 
pair Lj, Lj G C, the function x *— > p(x, Lj) is constant on Lj. 

If this is the case, we put p(Lj, Lj) = p(x, Lj), for any L iy Lj G £ and x G L^. Therefore, a 

stochastic matrix P = (p(Lj, I/j))jj'=i,-,fe can be defined, so that P can be regarded as the 
transition probability matrix of the lumped Markov chain, whose state space contains k 
elements, identified with the parts of the partition C. We will say that £ is a lumping of P. 
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It is easy to check that, if P is in detailed balance with respect to the probability measure 
7r, then P is reversible with respect to it\c, where ir(Li) is defined by ir(Li) = Y2 x eL k(x). 
Roughly speaking, lumpability means that some states of P can be aggregated and 
replaced by a single state, providing a Markov chain which has a smaller state space, but 
whose behavior is essentially the same as the original one. Observe that there can exist 
many different lumpings of the same Markov chain, which are not necessarily obtained 
via successively refinements of the corresponding partitions (see, for instance, Example 
ED- 

Let us denote by 1^, for i — 1, . . . , k, the characteristic function of L iy i.e, 

J 1 if x G Li 
I otherwise 

and let Wc be the subspace of L(X) generated by the functions {lLi}i=i,...,k- In other 
words, Wc is the subspace of L(X) constituted by the functions which are constant on 
each part of C. Denote by 5^ the Dirac function centered at L, in L{£). 

Proposition 1. P is lumpable with respect to £ if and only if the subspace Wc is P- 
invariant. Let x G X and suppose that x G Lj, for some j G {l,...,k}. Then 
P(liJ(x) = P{5L i ){Lj), so that there exists a bisection between the eigenf unctions of 
the lumped chain and the eigenf unctions of P which are constant on each part of £. If f 
is such an eigenf unction, with associated eigenvalue X, then the lumped eigenfunction f 
defined by f{Lj) = f(x) is well defined and has eigenvalue X. 

Proof. Let x G Lj. We have 

(Pl L .)(x) =p(x,Li) = ^p(x,y). 

and therefore Pl^ is constant on each part Lj of £ if and only if p(x, L t ) does not depend 
on x G Lj. If this is the case, one has p(x, L t ) = p(Lj, Li) = P(SL i )(Lj). Now let / be an 
eigenfunction of P with eigenvalue A, which is constant on each part of £. One has: 

k / \ k 

Xf(Lj) = A/(x) = (P/)(x) = £( 2>(*,l/)/(y)J = $>(L„L 4 )/(L,) = (Pf)(Lj), 

so that / still has eigenvalue A. □ 



It follows from Proposition [T] that o~{P) C o~(P). Thus, the spectral gap for P is 
never smaller than that of P. This fact is what makes lumping a possible strategy for 
accelerating convergence to the stationary distribution [TO] . 
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Example 1. Consider the Markov chain on the set X = {xo,X\,X2,x^}, with associated 
transition probability matrix P = (p(xi, Xj))jj = o,i,2,3 given by 

12 

Take the partition C of X given by X = L\ U L 2 , with Li = {xo, X2}, £2 = {%i, X3}. P is 
lumpable with respect to L and the matrix P of the lumped Markov chain is given by 

P= 1 -( 1 f 
2 V 11 

We have cr(P) = {1, |, 0} and the associated eigenspaces are W\, generated by the function 
/1 = (1,1,1,1), W2/3, generated by the function / 2 /3 = (1, 1, — 1, — 1) and Wo, generated 
by the functions / ,i = (1, -1, 0, 0)jmd / ,2 = (0,0,1,-1). Moreover, a(P) = {1^0} 
and the associated eigenspaces are W\, generated by the function f\ = (1,1) and Wo, 
generated by the function / = (1, —1). Note that the eigenspace VF2/3 does not contain 
any function which is constant on L\ and L 2 . 

Now suppose that P is lumpable with respect to the partition £ = {L l5 . . . , L^} of X 
and let P be the associated lumped Markov chain. Let P be lumpable with respect to 
the partition M = {M h ,. ..,M Ih } of C, where {l,...,k} = L§ =1 Ij, M h = U seIj L s and 

clearly h < k. Let us denote P the associated lumped Markov chain on Ai. Notice that 
M. is coarser than £ as a partition of X. We claim that M. is also a lumping partition of 
P. 

Let x G L Si C Mj t . We have to prove that p(x, Mj.) is constant on M^. We have 
p(x,M/.) = J^ p(x, y) = J^ J^ p(x, y) 

= J2p( l «> l >) = R Mi *> Mi s)> 

seij 
which does not depend on the particular choice of x G Mj i . 

2.2. Generalized crested product of Markov chains. Let (I, ^) be a finite poset. 
For every i E I, and J Q I, the following subsets of / can be defined [3]: 

• A(i) = {jel:jy i}, A[i] = A(i) u {i}, A(J) = U jeJ A(j), A[J] = U j&J A\j}. 

• H{i) ={jeI:j-< i}, H\i] = H{i) U {z}, H(J) = U jeJ H(j), H[J] = U jeJ H[j}. 

A subset J C / is said ancestral if, whenever i y j and j G J, then i G J. Note that by 
definition A(i) and A[i] are ancestral, for each i & I. The set A(i) is called the ancestral 
set of i, whereas the set H(i) is called the hereditary set of i. Finally, we recall that an 
antichain is a subset S C / in which no two distinct elements are comparable. 
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For each % G I, let Xj be a finite set, with |Xj| > 2, so that we can identify Xj with 
the set {0, 1, ... , |Xj| — 1}. Let Pi be a Markov chain on X, (as usual, we also denote by 
Pj the associated Markov operator on L(Xj)). Let /j = (<5i(xi,2/i))x i ,yie.x < be the identity 
matrix of size |Xj|, and let t/j = {ui{xi,yi)) Xuyi& Xi be the matrix whose entries are all 
equal to l/|Xj|. We still denote by /j and £/j the associated Markov operators on L(Xj), 
that we call the identity and the uniform operator, respectively. The generalized crested 
product is a new Markov chain defined on the space X\ x ■ ■ • x X n . 

Definition 3 (pj)]). Let (/, :<) be a finite poset, with \I\ = n, and let {p®}i<zi be a strict 
probability measure on J, so that p° > for every « 6/ and ^" =1 p° = 1. The generalized 
crested product of the Markov chains Pj defined by (/, :<) and {p°}jg/ is the Markov chain 
on X = X\ x • • • x X n whose associated Markov operator is 

iei \ \j€H(i) 

The probability transition on X associated with V will be denoted by p(x,y), for all 
x, y G X. For x, y G X we have: 

i£l jeH(i) j#H[i] 

The spectral analysis of these products of Markov chains has been performed in [T3] under 
the hypothesis of irreducibility for the Pj's, together with the study of ergodicity and of 
the fc-step transition probability. 

Remark 1. (The generalized Ehrenfest model) The generalized crested product can 
be seen as a generalization of the classical Ehrenfest diffusion model. This model consists 
of two urns numbered 0, 1 and n balls numbered 1, . . . ,n. A configuration is given by 
a placement of the balls into the urns. Note that there is no ordering inside the urns. 
At each step, a ball is randomly chosen (with probability 1/n) and it is moved to the 
other urn. In [TJ] we generalized it to the (C, X)-Ehrenfest model. Now put |Xj| = q, 
for each % — 1, . . . , n: then we have the following interpretation of the generalized crested 
product. Suppose that we have n balls numbered by 1, . . . ,n and q urns. Let (/, X) be 
a finite poset with n elements, so that a hierarchy is introduced in the set of balls. At 
each step, we choose a ball i according with a probability distribution p®: then we move 
it to another urn following a transition probability Pi and all the other balls numbered 
by indices j such that j -< i in the poset (/, -<) are moved uniformly to a new urn. The 
balls corresponding to all the other indices are not moved. 

2.3. Generalized wreath product of groups. Let (/, -<) be a finite poset, with |/| = n. 
For each i E I, let Xj be a finite set, with |Xj| > 2. For JCI, put Xj = Yl ieJ Xi. In 
particular, we put X = Xj. If K C J C J, let tt j k denote the natural projection from Xj 
onto Xk- In particular, we set ttj = iTj and xj = ttjx, for every x G X. Let A be the set 
of ancestral subsets of /. If J G A, then the equivalence relation ~j on X is defined as 

x ~j y ^=^ xj = yj, where x = (xi) ie i and y = (yi) ie i G X. 
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Definition 4 ([!]). A poset block structure is a pair (X, ~^t), where 

(1) X = Y\,j ^n Xi, with (J, ^) a finite poset and \Xi\ > 2, for each i & I; 

(2) ~_4 denotes the set of equivalence relations on X defined by all the ancestral 
subsets of 7. 

For each i G 7, let Gi be a permutation group on Xi and let Fj be the set of all functions 
from Xa(i) into Gi. For J C J, we put Fj = rLeJ^- ^n e l emen t of Fj will be denoted 
/ = (/<)»ei, with fi e ^- 

Definition 5. For each f & Fj, the action of / on X is defined by 
fx = y, with yi = (fiXA(i))Xi, for each i G 7. 

It is easy to verify that this is a faithful action of Fj on X. Therefore (Fj,X) is 
a permutation group, called the generalized wreath product of the permutation groups 
(Gi, Xi)i & i. 

Definition 6. An automorphism of a poset block structure (X, ~^) is a permutation a 
of X such that, for every equivalence relation ~j in ~_4, 

x ~j y ^^ (ax) ~j (ay), for all x,y E X. 

Denote by Sym(Xi) the symmetric group of X t . If \Xi\ = qi, we will also write Sym(qi). 
The following fundamental results are proven in [1]. 

Theorem 2. The generalized wreath product of the permutation groups (Gi,Xi)i^i is 

transitive on X if and only if (Gi, Xi) is transitive for each % G 7. If (X, ~^) is the poset 
block structure associated with the poset (7, <) and Fj is the generalized wreath product 
[l(i -<) Sym(Xi), then F/ is the automorphism group of (X, ~^). 

Example 2. If ^ is the identity relation (Fig. [1]), then the generalized wreath product 
is the permutation direct product (Gi,Xi) x (G 2 , AT 2 ) x • • • x (G n ,X n ). In this case, we 
have A(i) = 0, for each i G 7, so that an element / of Fj is given by / = (fi)iei, where /» 
is a function from a singleton {*} into Gi and so its action on Xi does not depend on any 
other coordinate of x. 



12 3 n 

Figure 1. 

If (7, d±) is a finite chain (Fig. [2]), then the generalized wreath product is the classical 
permutation wreath product (G\,X\) I (G21X2) I ■■■I (G n ,X n ). In this case, we have 
A(i) — {1, 2, . . . , i — 1}, for each i G 7, so that an element / G Fj is given by / = (fi)iei, 
with 

/i : Xi x • • • x Xi_i — ► G t 
In other words, the action of / on Xj depends on its "ancestral" coordinates x±, . . . , Xj_i. 
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Figure 2. 

Remark 2. In |19j . the generalized wreath product of graphs has been introduced (a 
different notion with respect to [20]), allowing to get the Cayley graph of a generalized 
wreath product of groups from the Cayley graphs of the single factor groups). 



3. Lumping the generalized crested product 

In this section we present three ways for lumping a generalized crested product of Markov 
chains. The first one is obtained by deleting coordinates indexed by some elements of /: 
this is a completely general method that can be applied without any assumption on the 
Markov chains Pj's. On the other hand, the two other lumping constructions are realized 
starting from a lumping partition of each factor set Xf. these are the direct product of 
lumping partitions, and the generalized product of lumping partitions, that reflects the 
ancestral equivalence relations defined by the poset. 

3.1. Deleting coordinates. Let (/, ^) be a finite poset, with |/| = n and let Xi, X , Pi, 
p® be as in Definition [31 Consider the generalized crested product of Markov chains V 
defined in ([1]). Observe that any element of X can be written as x — (xi, . . . ,x n ), with 
xi e Xi. 

The construction that we are going to introduce is quite natural. More precisely, we 
want to lump the Markov chain V by "deleting" some elements from the poset /. Let 
R C I and put I = I \ R. We declare equivalent any two elements (x±, . . . ,x n ) and 
(yi, . . . , y n ) of X such that Xi = yi for each i £ I. This construction produces a lumping 
consisting of t = Yliei\Xi\ parts Li, . . . , L t of the same cardinality YlieR 1-^*1 • 

Theorem 3. The function x h- >■ V(x, L s ) is constant on L^, for every k, s = 1, . . . , t. 

Proof. Let x = (x±, . . . , x n ) G Lfc. We have 

V(x,L s ) = ^p{x,y)=^^p° i p i (x i ,y i ) JJ ufa^y,) \\ S^x^yf) 

yeL s yeL s iel jeH(i) j&H[i] 



iel yeL s j£H(i) ' J ' j£H[i] 
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Fixed an index i, we have 

y£L s jeH(i) ' j ' j$H{i\ 



p°i n jx~\ J2 pi ^ yi "> n 5 oi. x vVi) 

jeH(i) ' jl WeL s j^[j] 



V 



■° n Mfj e p^ y*) n 5 i( x vvy) n ^o^v;)] 
= p °i n Tx~\ n 5 A x hVj) [^pfauvi) n ^o^*) 

since if j : G" R all the elements y G L s have the same j'-th coordinate. We can distinguish 
two cases. If i G R, then 

^Pite.yi) IJ 6 j( x j^yj) = ^2pi( x i^yi) = II I x jI' 

»/eL 3 je-R\-ff[i] y eL s j€RnH(i) 

with L s — {y E L s \ yj = Xj for all j E R\ H[i]}; ii i ^ R, then 

yeL s jeR\H{{\ ye z s jeRnH[i\ 

In both cases the sum is independent of x G Lk, since any x G Lk has the same z'-th 
coordinate if % G" R. D 

In what follows, we consider the generalized crested product in which any Markov oper- 
ator Pi is the uniform operator t/j. The following proposition explains how the operator V 
defined in (TjQ) changes after performing the lumping described in Theorem [3J In practice, 
we are removing from the tensor product the operators corresponding to the indices in R. 

Proposition 4. Let (I, ^) be a finite poset and R C I. Let V be the generalized crested 
product of Markov chains defined in flTJ, with P, = Ui, for each % G I . Denote by V the 
lumped Markov chain defined by R as in Theorem^ Then 

iei \jeH[i\\R J \j${H[ipR) 

Proof. By performing successive lumpings, it suffices to prove the statement for \R\ = 1. 
Let R = {r}. Recall that the lumping associated with R is obtained by identifying the 
elements x and y such that Xi = yi for each i ^ r. Let L s be a part of the corresponding 
partition. We have 

v(x,l s ) = j>°e n jxi n wwi)' 

iei yeL s jeH[i] ' j ' j£ff[i] 
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Fixed an index i, we can distinguish two cases. If r £ H[i], we get 

rfE n iff n ^^) = p?( e jh) n ^ n ^>%) 

= Pi II Txq II 5 A x iiVi)i 

jeH[i]\{r} 1 jl j$H{i\ 

where, for j (jL H[i], y,j is the j-th coordinate of any element y £ L s . If r g" fl"[z], we get 

p *E n ix7 n 8 j( x 3>vj) = p°i n nn n w^ys) e ^(^ 

= ^° II |^| II (5 i( x i'%)' 

where, for j g" (H[i] U {r}), j/j is the j-th coordinate of any element y £ L s . By summing 
up the terms corresponding to every i, we get the assertion. □ 

A natural question to be asked is under what conditions, after performing such a lump- 
ing, the lumped Markov chain V represents the generalized crested product with respect 
to the reduced poset (I, :<) obtained from (I, ^) by deleting the elements in R and pre- 
serving the remaining order relations. We will use the notation i < j by meaning of i -< j 
and there is no k £ I such that % -< k -< j. 

Definition 7. Let R C I and suppose that, for each r £ R, there exists a unique 
s(r) £ H[R] \ R, maximal in H[R] \ R, and a sequence C(r) = {r,r', . . . ,r ( - e \ s(r)} C 7, 
with r', . . . , r^' £ R, such that r' < r, r^) < r( fc_1 ) and s(r) < r^>. We say that R is fibered 
over S 1 = U rG #{s(r)}. 

Notice that the chain C(r) connecting r with s(r) is not necessarily unique. Moreover, 

(2) H(r) \R= {s(r)} U H(s(r)) = H[s(r)]. 

Roughly speaking, s(r) is the unique maximal element in H(r)\R that we meet descending 
from r, and there is no element of R in H[s(r)] . Moreover, s(r) is the maximum of H(r)\R 
and among the descendents of s(r) there cannot be elements of R (this is a consequence 
of the maximality property of s(r') for all r' £ R). If S — {s l5 . . . , s t }, the /jfeer i?« of Sj is 
the set of r £ i? such that (any) C(r) ends at Sj. If i? is fibered over 5 then R = U\ =1 Ri. 
In the poset (I, :<) in Fig. El for example, the set R = {2, 3, 4} is fibered over S = {5, 6}, 
with fibers R$ = {2,3} and Rq = {4}; the corresponding reduced poset is denoted by 
(I, 2<). On the other hand, the set R' = {1, 2, 3, 4} is not fibered over any subset S, since 
there are two maximal elements in H(l) \ R. 

Proposition 5. Let (I,di) and V be as in ([T]), with Pi = Ui, for each % £ I. Let 
R C I and V be the corresponding lumped Markov chain as in Proposition [|| Then V is 
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Figure 3. 

the generalized crested product associated with the poset (I, ^) if and only if there exists 
S = {si, . . . , s t } C H[R] \ R such that R is fibered over S . If this is the case, one has 



$ 



Pi 



if i?S 

P°i+P Sh tfi = Sh- 



3&Rs h fj ^ fsh 



Proof. Firstly, suppose that R is fibered over S. It follows from Proposition [4] that V is 
obtained from V by forgetting indices in R. We have: 






iei 




ieR \jeH[i]\B / \j2(ff[i]uR) / igfl \jeir[i]\B / \M#[i]ufl) 

Since i? is fibered over S, all indices belonging to the same fiber R m give rise to the same 
operator after deletion, so that by (|2]) we get 



^EE 




jg(H[sm,pR) J m=i \jetf[s m ] / w(i?[s m ]u.R) 



+ E rfl 09 ^H 09 4 

t^(flUS) \jeH[i\\R ) \j£{H[i]UR) 

= £(£?? + 



£ rfl <S> "/ 

,j>r ^ ^ ® I Q9 i* 

On the other hand if, given R, there is no S such that R is fibered over S, then only 
two possibilities may occur: there can exist r E R such that H(r) = 0; or there is 
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r G R with at least two maximal elements s, s' G H(r) \ R. In the first case, notice 
that {j G H[r] \ R} = and so there is at least a summand in V equal to p° (®j(jlrIj) 
which does not appear in any generalized crested product. In the second case, we get a 
summand containing a tensor product of the form 

(U s (8) U s i) (g> (®j g (il( s )uij( s '))^) ® (®j6/\(iJUH[s]UH[s'])-^') • 

Since the elements s, s' are not comparable, such a product does not appear in any gen- 
eralized crested product. This completes the proof. □ 

3.2. Direct product of lumpings. In this section, we introduce a more general con- 
struction of lumpings for the generalized crested product, that we call direct product of 
lumpings. 

Let (/, ■<) be a finite poset and let Pi be a lumpable Markov chain on Xi, for each i G I. 
Hence, there is a collection D = {L\, . . . ,L l ki } of subsets of Xi such that UjLjL*- = Xi 
and, for each s = 1, . . . , hi, the function x i-> Pi(x, L l s ) is constant on each part of D . 
Clearly, the cartesian product of partitions 

c = Y[c 

provides a partition of the cartesian product X = Yliei-^i- 

Theorem 6. For all parts L, U G C, the function x *— > V(x, L') is constant on L. 

Proof. By direct computation, 

^o>£') = ^2^2p°iPi(xi,yi) n M i( x i'%) n 5 A x 3iVj) 

yeL' iei jeH(i) j#H[i\ 

(3) = ^Pi^Pifruyi) n jxi n 6 j( x J^j)- 

iei y eV jeH({) ' 3 ' j#H[i] 

For each fixed index i, the summand in ([3]) becomes 

(4) p°i n ixi ^Piixuvi) n s 3( x 3>yj) ■ 

Let L = niLi -^v an d -^' = niLi -^1 ' with Si,ti G {1, ...,&$}. If there exists an index 
j (£ H[i] such that Sj ^ tj, then (jl]) is zero since 5j(xj,i/j) = for every y <E L'. If 
Sj = tj for any j g. H[i], then we have Il/ie.™ \^t h \ elements y such that yj = Xj for every 
j $. H[i\. Therefore we get 

since P» is lumpable. This proves that V(x, L') does not depend on x. □ 
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Remark 3. This second construction is more general than that one in Section I3TT1 In fact, 
fixed the deletion set R, we have that the corresponding lumping partition is obtained by 
taking the universal partition of Xi, for % £ R, and the identity partition of Xi, for i g 1 R. 

3.3. Generalized product of lumpings. We define here a more general construction, 
inspired by the definition of generalized wreath product of groups given in jl] (see Defini- 
tion [5]), and allowing to get new lumping partitions for the generalized crested product of 
Markov chains. We are going to define a class of lumping partitions on Yliei Xi reflecting 
the combinatorial structure of the poset (J, :<). 

Let Lj be the set of the partitions associated with all the possible lumpings of the Markov 
chain Pi on Xi, i.e. 

Lj = {C l : the Markov chain Pi on Xi is lumpable with respect to C 1 }. 

Let / = {h £ I : A(h) = 0}. For any h £ I we fix a lumping partition C h £ L^. The 
cartesian partition product Y\h&7 ^- h ls clearly a partition of Ylhel-^h- 

For any i £ /, such that A(i) C J, we define a map 

fi : J] £* ^ Lj, 

jeA(i) 

whose domain is the cartesian product of the lumping partitions that we have chosen 
for the sets Xj,j £ A(i), and yielding a lumping partition of Xj. Given an element 

L = UjeA(i) L i 3 e UjeA(i)£ 3 such that 

f i (L) = £ i = {L\,...,Li i }, 

then ]J L Lx fi (L) is a partition of the set n 7 eA(i) -^-j x -^*- ^ e denote such a new partition 
by £ j4 W. For every z £ J for which C A< ^ has been constructed, we define a map 

fi : L — y JLj, 

providing a new partition £ A H of riieAfil ^i' depending on fi. Continuing this way, after 
a finite number of steps we construct a partition of the whole X. 

Definition 8. The partition of X = fj i£7 Xi induced by the fi s is called the generalized 
product of lumpings. 

Example 3. Consider the first poset in Fig. HI and suppose that X{ = {0, 1} for each % £ 
/. Observe that A(l) = A(2) = and A(3) = {1}, A(4) = {1,2}. Choose C 1 = {{0, 1}} 

2 1 1 2 

and £ = {{0}, {1}} and define the maps f%:C — > L 3 and f± : £ x £ — >■ L 4 as 

/ 3 ({0,1}) = {{0},{1}}£L 3 

/ 4 ({0, 1} x {0}) = {0, 1} £ L 4 / 4 ({0, 1} x {1}) = {{0}, {1}} £ L 4 . 
This construction produces the following partition of X\ x X 2 x X 3 x X 4 : 

{0000, 1000, 0001, 1001} U {0010, 1010, 0011, 1011} U {0100, 1100} U {0110, 1110}U 

U{0101, 1101} U {0111, 1111}. 
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Consider now the chain in Fig. [Hand still assume Xi = {0, 1} for every % £ I. Observe 

that A(l) = 0, A(2) = {1}, and A(3) = {1,2}. Choose £ X = {{0},{1}}, and define the 

map f 2 : ~t -► L 2 as / 2 ({0}) = {{0}, {1}} £ L 2 and / 2 ({1}) = {{0, 1}} £ L 2 . Then we get 

the partition Z m = {{00}, {01}, {10, 11}} of X l xX 2 . Now define / 3 : £ A(3) = Z m ->■ L 3 
as, for instance, / 3 ({00}) = / 3 ({10, 11}) = {{0},{1}}, and / 3 ({01}) = {{0,1}}. With 
this choice, we obtain the partition {{000}, {001}, {010, 011}, {100, 110}, {101, 111}} of 
X 1 x X 2 x X 3 . 




Figure 4. 

Theorem 7. Any partition of X obtained as a generalized product of lumpings is a lump- 
ing partition of the corresponding generalized crested product of Markov chains. 



Proof. Any part defined by the construction described above can be represented as a 
product 

L = L) x L 2 , x • • • x Ul 

where L\. is a part of some D £ Lj. Moreover, for every i such that A{i) ^ 0, the subset 
D ti belongs to the partition D = fi([\j£A(i) ^t)- Let x = (xi, . . . ,x n ) £ L and let L' be 
another part of the new partition. Then 

v(x,L') = j2p°Y.p^y^ II tya II tfa'Vi)- 



iel yGL' 

Fix an index i and consider the summand 

o 



jeH(i) 



j<jLH[i\ 



p i n jY-\j2Pi( x ^yi) n 5 i( x i'%)- 

Notice that A{i) C J\ if[z]. Let x^, . . . ,x 
in A(i) 



so that (x^, 



X7 



be the entries of x corresponding to indices 
£ L\ x < Vr and fAL] 1 x • • • x Vr ) = C. We have 

that, if each of the 5j(xj,?/j)'s is not 0, then Xj = i/j for every j £ A{i). Since the L^.'s 
constitute a partition of Xj, this implies that they induce the same partition O under 
fi, so that Hi belongs to some part L\, of the same lumping partition O containing L\.. 
This implies that ^2 y£L > Pi(xi,Ui) does not depend on Xi, since C 1 is a lumping partition 

of X % . D 

Remark 4. Notice that the generalized product of lumpings contains the direct product 
defined in Section 13.21 as a particular case. In fact, in order to get the partition C = 

Q iG/ £\ it is enough to fix £ = C? for every j such that A(j) = 0, and to define the 
function fi to be constant and equal to D for any other index. 
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4. Insect Markov chain 

In this section we recall some basic properties of the Insect Markov chain, whose state 
space is the cartesian product of n finite sets, identified with the boundary of a poset 
block structure (see Definitions]). It was first introduced in [23] in the special case of the 
regular rooted tree, then studied in [8j Chapter 7] and [13], and generalized to different 
settings in [12j [T3] [15]. We will recall the construction introduced by the authors in [H] 
in the more general context of orthogonal block structures. Let (/, :<) be a finite poset, 
with |/| = n and suppose X\ = ■ ■ ■ = X n =: X, for every i G I. Let A be the set of all 
ancestral subsets of (/, -<). A has a natural poset structure: in (A, zi), we put A\ < A 2 
if and only if Ai D A 2 . By the notation A\ < A 2 , we mean that Ai -< A 2 and there is no 
A & A such that A\ -< A -< A 2 . The Markov operator associated with the Insect Markov 
chain is defined as 




with 

(5) p A = ^2 ai > A i ' ' ' aA '> A I 1 ~ 5Z " A ' L ) ' for every A ^ ^' 

CCA chain ^ A<L ' 

C={I,Ai,-,A'A} 

and 

(6) p% = ^2 ai ' Al ' ' ' aA '< % - 

CCA chain 
C={IAi,-A'fi} 

Here, for all A', A & A such that A' < A, the coefficients ctA'A are defined as 

(?) aA '' A = \{J:J<A'}\-\X\ + \{L:A'<L}\-\X\-Zj < a><*J,a>' 

In particular, ([7]) yields a^A = ul-1<\l\\ ' ^ or eacn I ^ A. For all / < A 1 < A, in the case 

a i a 1 = 1, the coefficient cka'A is not defined by (J7|) but as ola' a = \x\+\{l-a'<l\\ - 

The state space of the Insect Markov chain Vi is the cartesian product X n , regarded as 
the boundary of the poset block structure associated with (/, ^). We define 

(8) dj(x,y) = n — max{|A| : x ~a y}, for all x, y G X n . 

Lemma 1. di is a distance on X n . 

Proof. It is clear that dj satisfies di(x,y) > for all x,y G X n , and di(x,y) = if and 
only if x = y; moreover, one has di(x, y) = dj(y, x), for each x, y G X n . As regard as the 
triangular inequality, observe that the condition dj{x, z) < dj(x, y) + d I {y, z) is equivalent 
to 

(9) n + max{|A| : x ~a z) > max{|A| : x ~a y} + max{|A| : y ~^ z}. 

Jlt-M- JT-t./"l Jlt^i 
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If maxAe^llAI : x ~^ y} + max^ e _4{|A| : y ~^ z} < n, there is nothing to prove. If 
max J 4 G _4{|yl| : x ~^ y} + m&XAeA{\A\ : y ~a z} = n + h, with /i a positive integer, 
then there exist two ancestral sets A\ and A 2 such that max^ e _4{|/i| : x ~^ t/} = \Ai\ 
and max^ e _4{|A| : y ~^ 2;} = |A 2 | and |Ai| + \A 2 \ = n + h. On the other hand 
\A±\ + \A 2 \ — \A\ fl A 2 \ < n. This implies that \A\ D -A2I > /i and, since Ai D A 2 G -4, one 
has maxyig^dAI : 2 ~a z} > h and so (jHJ) holds. D 

The Insect Markov chain is invariant under the action of the generalized wreath product 
Fj of the groups Sym(X), which acts by automorphisms on X n (see Theorem [2]). This 
implies that the probability of reaching y from x only depends on the distance di(x,y). 

Example 4. Consider the poset (J, :<) in Fig. [5] and assume that X = {0, 1}. Then A = 



(1,1) 



{1} 
{1,2} 



{2} (A,<) 



Figure 5. 



{0, {1}, {2}, {1, 2}, I}. The associated poset (A, z^) is represented in Figure|5j According 
with OH]), we have: 

• rf 7 (000,000) = 0; 

• d 7 (000,001) = 1; 



• d/(000,010) = di 

• d/(000,110) = dj 


(000,011) = d/(000,100) 
(000,111) = 3. 


= d/(000,101) = 2; 


By using formulas (JZJ), we get: 




«/,{l,2} = I7 «{1,2},{1} = tt{l,2},{2} = 


1 2 

= 4, «{1},0 = tt{2},0 = - 


and then, using flSJ) and (JH]), 




1 
P{i.2} = 2' P« = Pi 2 ) = 


3 1 

= 20' m= 5- 


The associated Markov operator is then 




1 3 

Vi = -I®I®U + —I®U ®u + 


3 1 
— U®I®U+-U®Ui 




/28 28 5 5 5 5 
28 28 5 5 5 5 


to to ' 
to to 






5 5 28 28 2 2 


5 5 




1 


5 5 28 28 2 2 


5 5 




80" 


5 5 2 2 28 28 


5 5 


> 




5 5 2 2 28 28 


5 5 






2 2 5 5 5 5 


28 28 






^2 2 5 5 5 5 


28 28^ 





u 
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according with the fact that the probability transition p(x,y) is a function of di(x,y). 

Example 5. Consider the Insect Markov chain on {0, l} 3 associated with the first poset 
in Fig. El whose Markov operator is 



Pi 



7 



4 2 

U ®U <8>U H I ®U ®U + -I ®I ®U. 

_ _l_ o 



If we apply the deletion construction of Section I3TT1 with R = {1}, so that S = {2}, we 
get 



7 



ZiY o o o 



which is the Insect Markov chain on the reduced poset. On the other hand, with the 
choice R' = {3}, we have 

Vi» = -U ®U + —I ®U + -I ® /, 

which is not a generalized crested product of Markov chains, since R' is not fibered on 
any set, according with Proposition |5j 



lx 
2 



1 
2 
3x 



Figure 6. 



5. Group actions and lumpability 



5.1. General properties. Many lumpings are generated by the action of a group on a 
set. More precisely, let P be a reversible Markov chain with state space X and let G be 
a group acting on X such that 



(10) 



p(gx,gy) =p{x,y), 



for all g G G,x,y G X. 



The action of G induces a partition of X given by the orbits. Denote by G x the orbit of 
the element x G X under the action of G. By defining 



;n) 



p G (G x ,G y ) =p(x,G y ) = ^ P( x iV') 

y'eGy 



then one gets a lumping of X providing a new Markov chain defined on the space of the 
orbits. In fact, it is straightforward to verify that pG(G x ,G y ) does not depend on the 
choice of x, so that the lumped Markov chain Pq is well defined. The following results 
can be found in [6]. 



18 DANIELE D'ANGELI AND ALFREDO DONNO 

Proposition 8. Let P be a reversible Markov chain on X and G a group satisfying f llOp . 
Let Pa be the Markov chain defined in (fTTjl . If f is an eigenfunction of Pq with eigenvalue 
\, then A is an eigenvalue of P with G -invariant eigenfunction f such that f(x) = f(G x ), 
for each x G X . Conversely, every G -invariant eigenfunction appears uniquely from this 
construction. 

The following proposition provides a condition for an eigenfunction of P to project to a 
nontrivial eigenfunction of Pq. 

Proposition 9. Let f be an eigenfunction of P with eigenvalue A, and put f(x) = 
^2i Q€ q f{g~ l x). If f 7^ 0, then f defined as f(G x ) = f(x) is an eigenfunction of Pq 
with eigenvalue A. 

The next proposition relies the spectral analysis of a lumped Markov chain induced by 
the action of a group, with the representation theory of the corresponding group. 

Proposition 10. Let P be a reversible Markov chain on X , with a transitive automor- 
phism group G satisfying ffTUj) . Let 

L{X) = 01/ 8 

i=0 

be the isotypic decomposition of L(X) under the action of G, with Vi = d$Vi, where Wi are 
irreducible representations of G pairwise non isomorphic. Suppose X = G/H. Then, the 
Markov chain Ph has Yli=o di distinct eigenvalues, with di eigenvalues having multiplicity 
dimWi in the Markov chain P. 

Example 6 (Spherical lumping on the rooted tree). Consider the case of the Insect 
Markov chain V associated with the totally ordered set (I, :<) in Fig. [2j We assume 
X := Xi = ■ ■ ■ = X n , with \X\ = q, so that the state space can be identified with the set 
of finite words of length n over the alphabet {0, 1, . . . , q — 1}. V is invariant with respect 
to the classical iterated wreath product 

G = Sym(q) I ■ ■ ■ I Sym(q) . 



n times 



The associated poset block structure is the rooted g-ary tree T q ^ n of depth n, and the 
action of G is transitive on each level of the tree, in particular on its boundary identified 
with X n . If we fix the element Xq = n and consider the subgroup H = Stabcixo) , then 
X n can be regarded as the homogeneous space X n = G/H. It is known [51 El [HI E3] 
that (G, H) is a Gelfand pair, so the decomposition of the space L(X n ) into irreducible 
submodules under the action of G is multiplicity-free: 

n 
3=0 

where Wq is the trivial representation and, for every j = 1, . . . , n, 

Wj = L{X) <8> • • • ® L(X) ®L(X)i <g> L{X) <g> • • • ® L{X) , 



(j— 1) times (n— j) times 
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where L(X) denotes the subspace of constant functions in L(X) and L(X)i — {/ : X — > 
C | J2xex f( x ) = 0}- Therefore, we have dim Wo = 1 and dim W, = q^ x {q — 1), for every 
j = 1, ... ,n. W is the eigenspace associated with the eigenvalue A = 1, whereas the 
eigenvalue associated with W«, for j = 1, . . . , n, is A,- = 1 



g-i 



j, ±wx j j., . . . , it, xo • ij x gn-j + l-l' 

It is clear that the orbits in X n under the action of Stabcixo) are the spheres S r (xo) 
centered at xq of radius r, for r = 0, . . . ,n, defined with respect to the distance di that 
coincides, in this case where the poset block structure is the tree T q>n , with the usual 
ultrametric distance d on the boundary of the tree. Therefore, the lumped Markov chain 
Vh has n + 1 states, and each of the eigenvalues Xj, for j = 0, . . . , n is an eigenvalue of 
Vh with multiplicity 1. Up to normalization, the eigenfunction of Vh associated with 



1 is the constant function; the eigenfunction associated with A,-, for j 



Ar 



the function fj such that 



(12) 



1 if r < n — j + 1 
if r > n — j ' + 1 . 



In the case q = 2, n = 3, and Xq = 000, the partition of {0, l} 3 induced by the action of 
H = Stab G (000) is 



{0, l} 3 = S (x ) U Siixo) U ^ 2 (x ) U S 3 {xq), 



with 



So(x ) = {000}, S 1 {x ) = {001}, S 2 {x ) = {010, 011}, S 3 (x ) = {100, 101, 110, 111}. 
The transition probability matrices are 



V 





/67 67 11 11 3 3 3 3\ 
67 67 11 11 3 3 3 3 








11 11 67 67 3 3 3 3 


/67 67 22 12 \ 


1 

68 


11 11 67 67 3 3 3 3 
3 3 3 3 67 67 11 11 


v H = l 

H 168 


67 67 22 12 
11 11 134 12 




3 3 3 3 67 67 11 11 
3 3 3 3 11 11 67 67 


\3 3 6 156/ 




\3 3 3 3 11 11 67 67/ 







The eigenspaces of V are: 

(1) Wo, with eigenvalue 1, of dimension 1, generated by the function 

/„ = (1,1, 1,1, 1,1, 1,1); 

(2) Wi, with eigenvalue 6/7, of dimension 1, generated by the function 

A = (1,1, 1,1, -1,-1, -1,-1); 

(3) W2, with eigenvalue 2/3, of dimension 2, generated by the functions 

/ 2>1 = (1, 1, -1, -1, 0, 0, 0, 0) / 2 , 2 = (0, 0, 0, 0, 1, 1, -1, -1); 
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(4) W3, with eigenvalue 0, of dimension 4, generated by the functions 
/ 3 ,i = (1, -1, 0, 0, 0, 0, 0, 0) / 3)2 = (0, 0, 1, -1, 0, 0, 0, 0) 
/ 3 ,3 = (0, 0, 0, 0, 1, -1, 0, 0) / 3 , 4 = (0, 0, 0, 0, 0, 0, 1,-1). 
All the eigenspaces of Vh have dimension 1 and they are: 

(1) Wo, with eigenvalue 1, generated by the function f = (1,1,1,1); 

(2) W\, with eigenvalue 6/7, generated by the function /1 = (1, 1, 1, —1); 

(3) W2, with eigenvalue 2/3, generated by the function / 2 = (1, 1, —1, 0); 

(4) W3, with eigenvalue 0, generated by the function / 3 = (1, —1, 0, 0), 

according with Proposition [9] and (fT2~l ) . 

5.2. The case of the Insect Markov chain on the rooted tree. We restrict now our 
attention to the Insect Markov chain on the cartesian product X n = X x • • • x X, with 
\X\ = q, associated with the totally ordered set (/, <) in Fig. [2J In this case, the poset 
block structure is a regular rooted tree of degree q, so that X n can be identified with the 
boundary of T g „. 

Fix a vertex x G X n . Using (jSJ), (JBJ), dZj), (see also [13]), we obtain that the transition 
probabilities associated with this Markov chain are 

(13) p(x , xq) = p(x , x) = q~ l {l - ai) + ^ q~ l a t ■ ■ ■ 0^-1(1 - a*), if d(x , x) = 1 

i=2 

and, more generally, 

v. 

(14) p(x ,x) = '^2q~ l a 1 ---a i - 1 (l- ai), if d{x ,x) = j > 1, 

i=j 

where the coefficients a^-'s satisfy the recursive relation aj = -^ + oij-.\OLj-^ and are 
described by 

(15) \ a i = ^h for l<J<n-l 

|a = 1 «n = 0. 

Observe that the Markov chain is in detailed balance with the uniform distribution it on 
X n given by n(x) = \, for each x G X n . 

Now let C = {L\, . . . , Lfc} be a lumping of the Insect Markov chain. Take an element 
x G X n and suppose that x G L r , for some r G {1, . . . , k}. For every i = 0, 1, . . . , n, and 
s = 1, . . . , k, define: 

(16) \i, s = \{xeX n : d(x ,x) = i and x <E L s }\. 

In other words, Aj iS is the cardinality of the intersection of the sphere of radius i centered 
at Xq, with the part L s of C. In particular, one has: 

J 1 if s = r 
1 otherwise. 



LUMPABILITY FOR MARKOV CHAINS ON POSET BLOCK STRUCTURES 21 

Theorem 11. Let £ = {L 1; . . . , L^} be a lumping of the Insect Markov chain on X n . Let 
x ,y G L r and let A^ s , yU is be the associated coefficients, respectively, defined as in (IToT) . 
Then 

\,s = Hi,s f or each i — 0, . . . , n and s — 1, . . . , k. 

Proof. Since £ is a lumping and x ,y belong to the same part L r , we have p(x ,L s ) = 
p(yo, L s ) for each s, and so 

J2[ Yl pOo,0 =5Z Yl p(yo,y s 

i=0 \x s £L s , d(x ,x s )=i J i=0 \y s eL s , d(y ,y s )=i 

Since the transition probability p(x ,x s ) (resp. p(yo,Us)) only depends on the distance 
between xq and x s (resp. yo and y s ), we then get 

n n 

(17) ^ \sP(x , X 8 ) = ^ A*i,«P(l/0. Vs)- 

i=0 i=Q 

{if s = r 
. Moreover, it must be 
otherwise 

n n 

(is) y^A M =y^ y (j, i>s = \l s \. 

Hence, by using ffl"3]) . (JHJ), ffT5|) and (fl"8l) . we can rewrite (TTTj) as 

n— 1 / n— 1 .. \ 

Suppose now, by the absurd, that Ai iS ^ /J*i, s - We can assume, without loss of generality, 
that Ai )S — /j,i jS > 0. By dividing, we get 

n— 1 -. n—1 / , n— 1 -. 

(19) U (<7 m " W - 1) + § ^M " ^M § (f +1 - W " 1), ' = °' 



We want to show that the left-hand side of ( 1191) is actually strictly greater than 0. To 

see that, observe that the difference Ai :S — /^i jS must be at least equal to 1, whereas the 

difference Xj jS — \i^ s cannot be smaller than —q-'~ 1 {q — 1), for every j — 1, . . . , n — 1. 

Therefore, the minimal value that the left-hand side of ffTTJl) can take is obtained by 

replacing the occurrence Ai jS — /ii jS by 1 and the occurrences A J;S — jUj )S by —q-'~ 1 (q — 1). 

After some computations, one gets 

n-l 1 ,- 

(20) V 1 ~ Q +Q 

1 ] ^(q^-lW-lY 

_2_ -J_ 

By using the decomposition , i+i\ ( i_^ = — i+iLi + "T~[> one obtains that the ratio — j- 
is multiplied by -^- in (120]) . the ratio -^— j- is multiplied by ~ q+g _~ g ; and the ratio -^ 
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is multiplied by —(q + 1), for every j = 2, . . . , n — 1. By collecting all terms, we get 

J_p_ + «--« , -«_ (t+1) gl 

?-lU-l g n -l w ^t c i 

where, for each j > 1, we put Cj = J2 J k=0 q k - By using the inequality -^ < jA ^ and 
developing the sum, we finally get 

1 q n -q 2 -q ^ 1 \ _ g n ~ 3 (2g - 1) - 1 



^■)£i> ,-,- m ;-i) >o 



q — 1 \q — 1 g n — 1 ^ Cj I q n 3 (q — l) 2 (q 



for every n > 2 (the case n = 1 is trivial). This is absurd. 

The general case can be treated analogously. So let k be the smallest index such that 
Afc, s 7^ yUfc.s and put S = J2i=o \s — SjJo A*i,«- ^ ^ s eas y to check that it must be 
-^fc,s = hS, /ifc iS = /iS", for some h, h 6 {0, 1, . . . , q — 1}. 

This implies 

-(<? - 1)5* < A M - /^ < (g - 1)5. 
By iterating this argument, one obtains that, for every £ — 1, . . . ,n — k — 1, one has 

-q\q - \)S < \ k+t , jS - fJ, k+eiS < q\q - \)S. 

On the other hand, if we assume X ktS ~ ^k,s > 0, we have that X kiS — fi ktS must be at least 
equal to S. By arguing as in the previous case, we get the equation 

n— 1 -, n— 1 




1 



. (q l+1 -l)(q l - 

i=k v /v ' j=k+l \ ' ' 1=3 v /v 

Therefore, the minimal value that the left-hand side of (12"T|) can take is 



0. 



1 - gJ- fc+i + q 



n-\ 



This expression can be rewritten as 



n n~k+l n 2 n 2 i 



g — 1 \ g fc — 1 g n 



j=fc 



By using again the estimate — < j-_J ^ , for each j = k, . . . ,n— 2, one can show that this 
is a strictly positive quantity for every k < n — 1, obtaining the final contradiction. □ 

Remark 5. We have already remarked that £ is a lumping partition of the Insect Markov 
chain on T gn if and only if (ITT)) holds. The Theorem [11] ensures that not only the sums 
in (ITT]) coincide, but it must be X itS = fXi jS for all i, s. 

In what follows we denote by Z\, . . . , z q n-i the vertices of the (n — l)-st level of the rooted 
g-ary tree T q ^ n , identified with the cartesian product X n_1 . Hence, the vertices of the n- 
th level whose prefix of length n — 1 is Zi have the form ZiX, with x 6 {0, 1, . . . , q — 1}. 
We write T; for the set of vertices of type {zix}. Notice that Tj is isomorphic to T gl . If 
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C = {L\, . . . , L k } is a lumping of the Insect Markov chain on X n , we denote by T? = TiHLj 
the set of vertices in the class Lj belonging to the subtree rooted at the vertex Zi G X™" 1 
(see Fig. [7]). Observe that |T/| = Aoj + Aij, where Aoj and Aij are referred to any 
element in T- . 




ZiO Zjl Zj(g — 1) 

Figure 7. The regular rooted tree T q n 



Lemma 2. Let C = {L\, . . . , L k } be a lumping of the Insect Markov Chain on X n and 
let L\ be the set of vertices in X n ~ x obtained by deleting the last letter from the elements 
in Li. If there exist indices i,j such that L\ fl !/■ 7^ 0, then L\ = L'-. 

Proof. If L\ fl L', 7^ 0, then there exist two elements ZhX G Li and ZhV G Lj. Any other 
element in L\ comes from an element of type z s x' G Li. It follows from Theorem [Til that 
there is a bijection between T^ and T/, so there exists y' such that z s y' G Lj. Hence, 

K = l). a 

The previous lemma implies that the sets Z^'s provide a partition of X n ~ l . It is enough to 
choose one representative for those indices such that L\ = L'. Clearly, since UjLj = X n , we 
have UjL- = X n ~ l . We still denote the induced partition on X n ' 1 by CJ = {L[, . . . , L' h }, 
where h < k. 



Lemma 3. Under the hypotheses of Lemma [J| CJ 
Insect Markov chain on X n ~ l . 



{L[, . . . , L' h } is a lumping for the 



Proof. It follows from Theorem [TTJ that CJ is a lumping partition for the Insect Markov 
chain on X n ~ x if and only if, given Zi,Zj G L' r , the corresponding indices \' k s (zJ) and 

{, . . . ,h. Suppose that there exist 



Ai 



^Zj) coincide for every k 



0. 



7? 



1 and s 
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indices £, t such that X' it (zi) ^ \' it (zj). This implies that there exist ZiX,Zjy £ L r such 
that 

Xi+i,t{zix) = \Ti\\' tit (zi) ^ \Ti\X ttt (zj) = Xi+uizjy). 

This is a contradiction, since £ is a lumping for the Insect Markov chain on X n . □ 

The next result shows that, for the Insect Markov chain associated with the poset of Fig. 
El any lumping comes from the action of a suitable automorphism group of the rooted 
tree T qn . Denote by Aut{T qn ) = Sym(q) I ■ ■ ■ I Sym(q) the group of all automorphisms 

V v ' 

n times 

of the rooted g-ary tree of depth n. 

Theorem 12. Let Vi be the Insect Markov chain on the boundary X n ofT q ^ n . Let C = 
{Li, . . . ,Lk} be a lumping partition for V\. Then there exists K < Aut(T q ^ n ) such that 
the orbit partition of X n under the action of K is Llf =1 Lj. 

Proof. The proof works by induction on the depth of the tree. 

For n = l, each part Li can be represented as Li = {xi t , . . .,Xi ..} C X. Then it is 
enough to take K =< a >< Sym(q), where a is the permutation of Sym(q) whose cyclic 
decomposition is given by the product of cycles n^i^n ' ' ' X U-)- 

Let £ be a lumping for the Insect Markov chain on X n . It follows from Theorem [TT1 that . 
if Tj = {zjX : x £ {0, 1, . . . , q — 1}} decomposes as Tj = T n U . . .UT m ' , then for any other 

index s such that Tj' ^ (for t = 1, . . . , rrii), it must be T s = Tj 1 U . . . U T s mi . Moreover, 
there exists a bijection between Tj* and T,?', for every t = 1, . . . , m,. By deleting the last 
letter from vertices in L we get, from Lemma [31 a lumping partition C for the Insect 
Markov chain on X n ~ l . By induction, there exists a subgroup H < Aut(T q ^ n -i) whose 
orbits on X n ~ l provide the partition £'. 

The subgroup K satisfying the claim is obtained by extending in a suitable way (com- 
patible with the decomposition in any Tj) the action of elements in H to Aut(T qtTl ), and by 
adding elements acting nontrivially only on selected subsets of type T lt . Observe that any 
h £ H induces a permutation of X n_1 . We can associate with h an element h £ Aut(T q ^ n ) 
such that 

ZiX, if h(zi) = Zi 



\ ZjO- hti (x) if h(zi) = Zj 
where 07^ £ Sym(q) is a permutation (obtained by product of cycles) such that 



h(T?) = T 



for every t = l,...,mj. Moreover, for any non empty set T/ we define the element 
g it j £ Aut{T qn ) such that 

if s 7^ i 
gij(z s x) = I ZiX if s = i and x g" T/ , 

if s = i and x £ T- 
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where Tjj G Sym(q) is a cyclic permutation of the elements in T/. Define 

K:=<h, 9iJ : /iGi/,iG{l,...,rt J 6 {1, . . . , fc}, 2|> > . 

By construction, every part of £ is closed under the action of K, since it is closed under 
the elements h and gtj. The orbit decomposition of X n under K is given by L\ U . . . U Lk, 
i.e., the action of K is transitive on each part of C. In fact, suppose that z s x and z p y 
are elements in the same part L r . Then there exists h G H such that h(z s ) = z v . By 
definition, the automorphism g = g c VT h G K, where c satisfies 9p r (ch,s{x)) — Vi is suc h 
that g(z s x) = z p y. □ 

Remark 6. The group K is not uniquely determined, i.e., there exist different subgroups 
of Aut(T q , n ) providing to the same lumping partition. 

In contrast with Theorem [TJl for the generalized Insect Markov chain associated with 
any poset (I, ^) that is not a chain or, equivalently, that contains two elements which are 
not comparable, it is easy to find examples of lumping partitions that are not induced by 
any subgroup of the corresponding generalized wreath product of permutation groups. 

Example 7. Consider the poset (/, ^) in Fig. [TJ for n = 2, and suppose that X :— X± — 
X2 = {0, 1, . . . , q — 1}. Let Vi = \{U <8> I + I <S> U) be the Insect Markov chain associated 

with (I, -<). Take the lumping C given by L\ = {00, (q — l)(q — 1)}, L 2 = {0(g — 1)}, 
L 3 = {(q- 1)0}, L 4 = {Ox, {q - l)y: x,y ^ 0,q - 1}, L 5 = X 2 \ (uf =1 L;). One can check 
that such a partition cannot be induced by any subgroup of Sym(q) x Sym(q). 

Actually, the following more general result holds. 

Proposition 13. Let (J, X) be a finite poset, with \I\ = n, and suppose that there exist 
i,j G / such that i -/{ j and j -ft i. Let Vi be the Insect Markov chain on X n associated 
with (I, ^) and let Fi be the corresponding automorphism group. Then there exists a 
lumping ofVi which is not induced by any subgroup of Fj. 

Proof. Let % and j be two elements of / such that i -/(. j and j -ft, i. As in Example [3 we 
can define on the cartesian product X-i x Xj = X x X a lumping £ which is not induced 
by any subgroup of Sym(Xi) x Sym(Xj) ~ Sym(q) x Sym(q). We can extend such a 
lumping to a lumping £ of X n by saying that x — (xi, . . . , x n ) and y — (y\, ... , y n ) belong 
to the same part of C if and only if (x«, Xj) and (?/«, y,f) belong to the same part of C We 
can distinguish two cases. 

If A(i) = A(j) = 0, then the restriction of the action of Fj on the factors X t and Xj 
coincides with the action of the group Sym(q) x Sym(q), what implies that we cannot 
find any subgroup H < Fj whose orbits coincide with the parts of C. 

On the other hand, in the case A(i),A(j) ^ 0, we can assume A := A(i) = A(j). Any 
element x G X n can be represented as x = (xa, %i, %j, xc) where xa = (x^, . . . , Xi t ), with 
l m G A and xc = (x Cl , ■ ■ ■ ,x Cs ), with {ci, . . . ,c s } — I \ (A U {i,j})- If we admit that 
the lumping partition C is induced by a group K, then there must exist an | A | -tuple za 
and an automorphism / = (fi)iei G K such that fh{zA) = o~h G Sym(Xh), h = i,j, with 
0>i(O) = q — 1. On the other hand, the action of ah on the part of £ induced by the part 
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L 2 € C, for instance, produces an element which does not belong to the same part. This 
is a contradiction. □ 

Example 8 (Spherical lumping on a poset block structure via Gelfand pairs). 

Take the Insect Markov chain V associated with a poset (I, ^). Assume that X :— X\ — 
■ ■ ■ = X n , with \X\ = q. We know that the state space X n of V is the boundary of the 
poset block structure associated with (I, -<), whose automorphism group is the generalized 
wreath product Fj of the symmetric groups Sym(Xi). Moreover, V is invariant with 
respect to such a group. 

If we fix the element Xq = n and consider the subgroup H = Stabpj (xq), then X n can be 
regarded as the homogeneous space X n = Fi/H. In [TJj the authors showed that (Fj, H) 
is a Gelfand pair, so the decomposition of the space L(X n ) into irreducible submodules 
under the action of Fi is multiplicity-free: L(X n ) = ® 5C/ antic h a in Ws, with 




W s = (X) L{Xi) | ® | (X)i(Xi)i I ® ' (£) L(Xi) 

K i$A[S] 

where the subspaces L(JQ)o and L(Xi)i are defined as in Example Observe that 
the irreducible submodules are indexed by the antichains of (I, ^). On the other hand, 
the orbits in X n under the action of H are also indexed by the antichains [H]: X n = 

Use/ antichain °S, With 





°H n * >< n^NP 



ies 1 



where X° = {0} and X/ = Xi\ {0}. Since the cardinality of the state space of the lumped 
Markov chain Vh is equal to the number of orbits, it follows from Proposition [10] that 
each of the eigenvalues listed in p3] for V is an eigenvalue of Vh with multiplicity 1. The 
corresponding eigenvectors can be easily deduced by the analysis performed in [1] 



References 

[1] D. Aldous, P. Diaconis, Shuffling cards and stopping times, Amcr. Math. Monthly 93 (1986) 333-348. 

[2] D. Aldous, J. Fill, Reversible Markov Chains and Random Walks on Graphs, monograph in prepa- 
ration (http://www.stat.bcrkclcy.edu/uscrs/aldous/RWG/book.html). 

[3] R. A. Bailey. P. J. Cameron, Crested products of association schemes, J. London Math. Soc. (2) 72 
(2005) 1-24. 

[4] R. A. Bailey, Cheryl E. Praegcr, C. A. Rowley, T. P. Speed, Generalized wreath products of permu- 
tation groups, Proc. London Math. Soc. (3) 47 (1983) 69-82. 

[5] M. B. Bekka, P. de la Harpe, Irreducibility of unitary group representations and reproducing kernels 
Hilbert spaces. Appendix by the authors in collaboration with R. Grigorchuk, Expo. Math. 21 (2003) 
115-149. 

[6] S. Boyd, P. Diaconis, P. Parrilo, L. Xiao, Symmetry analysis of reversible Markov chains, Internet 
Math. 2 (2005) 31-71. 

[7] T. Ceccherini-Silbcrstcin. F. Scarabotti, F. Tolli, Trees, wreath products and finite Gelfand pairs, 
Adv. Math. 206 (2006) 503-537. 



LUMPABILITY FOR MARKOV CHAINS ON POSET BLOCK STRUCTURES 27 

[8] T. Ceccherini-Silberstein, F. Scarabotti, F. Tolli, Harmonic Analysis on Finite Groups: Represen- 
tation theory, Gelfand pairs and Markov chains. Cambridge Studies in Advanced Mathematics 108, 
Cambridge University Press, Cambridge, 2008. 
[9] G.-Y. Chen, L. Saloffe-Coste, The cutoff phenomenon for ergodic Markov processes, Electron. J. 
Probab. 13 (2008) 26-78. 

[10] G. W. Cobb, Y.-P. Chen, An application of Markov chain Monte Carlo to community ecology, Amcr. 
Math. Monthly 110 (2003) 265-288. 

[11] D. D'Angeli, A. Donno, Self-similar groups and Unite Gelfand pairs, Algebra Discrete Math. 2 (2007) 
54-69. 

[12] D. D'Angeli, A. Donno, Crested products of Markov chains, Ann. Appl. Probab. 19 (2009) 414-453. 

[13] D. D'Angeli, A. Donno, No cut-off phenomenon for the "Insect Markov chain", Monatsh. Math. 156 

(2009) 201-210. 

[14] D. D'Angeli, A. Donno, Markov chains on orthogonal block structures, European J. Combin. 31 

(2010) 34-46. 

[15] D. D'Angeli, A. Donno, Generalized crested products of Markov chains, European J. Combin. 32 

(2011) 243-257. 

[16] P. Diaconis, Group representations in probability and statistics, Institute of Mathematical Statistics 

Lecture Notes Monograph Scries 11. Institute of Mathematical Statistics, Hayward, CA, 1988. 
[17] P. Diaconis, The cutoff phenomenon in finite Markov chains, Proc. Nat. Acad. Sci. U.S.A. 93 (1996) 

1659-1664. 
[18] P. Diaconis, The mathematics of mixing things up, J. Stat. Phys. 144 (2011) 445-458. 
[19] A. Donno, Generalized wreath products of graphs and groups, submitted. 

[20] A. Erschler, Generalized wreath products, Int. Math. Res. Not. (2006), Article ID 57835, 14 pp.. 
[21] A. Farago, On the Convergence Rate of Quasi Lumpable Markov Chains, Proceedings of the 

Third European Conference on Formal Methods and Stochastic Models for Performance Evaluation 

(EPEW'06, Budapest, Hungary, June 21-22, 2006), 138-147, Springer- Verlag Berlin, Heidelberg, 

2006. 
[22] A. Farago, Speeeding Up Markov Chain Monte Carlo Algorithms, Proceedings of the 2006 Interna- 
tional Conference on Foundations of Computer Science (FCS'06, Las Vegas, Nevada, June 26-29, 

2006), 102-108. 
[23] A. Figa-Talamanca, An application of Gelfand pairs to a problem of diffusion in compact ultramctric 

spaces, in: Topics in Probability and Lie Groups: Boundary Theory, CRM Proc. Lecture Notes 28, 

Amcr. Math. Soc, Providence, RI, 2001, 51-67, 
[24] B. Franceschinis, R. R. Muntz, Bounds for quasi-lumpable Markov chains, Performance Evaluation 

20 (1994) 223-243. 
[25] F. Scarabotti, F. Tolli, Spectral analysis of finite Markov chains with spherical symmetries, Adv. in 

Appl. Math. 38 (2007), 445-481. 
[26] F. Scarabotti, F. Tolli, Harmonic analysis on a finite homogeneous space, Proc. Lond. Math. Soc. 

(3) 100 (2010) 348-376. 
[27] W. Woess, Dcnumcrable Markov chains: Generating functions, Boundary theory, Random walks on 

trees. EMS Textbooks in Mathematics, European Mathematical Society Zucrich, 2009. 
[28] H. Zhou, K. Lange, Composition Markov chains of multinomial type, Adv. in Appl. Probab. 41 

(2009), 270-291. 



28 DANIELE D'ANGELI AND ALFREDO DONNO 

Departamento de Matematica, Universidade de Tras-os-Montes e Alto Douro, Quinta 
do Prado, Vila Real 5001-801, Portugal 

E-mail address: dangeli@utad.pt 

DlPARTIMENTO DI SCIENZE DI BASE E APPLICATE PER L'lNGEGNERIA, SEZIONE DI MATEMATICA, 

Sapienza Universita di Roma, Via A. Scarpa, 16 00161 Roma, Italia. Phone: +39 06 
49766627. 

E-mail address: alfredo.donno@sbai.uniromal.it 



